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ABSTRACT 


An investigation of expected sample size (E[N]), 
variance of sample size (V[N]) and robustness of four 
Sequential tests applicable to testing bombing system 
accuracy is made using computer simulation. 

Operating characteristics, E[N], V[N] and error rates 


for these tests are presented. 
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In this thesis the Sequential Rayleigh Test and three 
sequential binomial tests, which are applicable to testing 
bombing system accuracy, are compared by computer simulation. 

The objective of this thesis is to investigate expected 
sample size, variance of sample size, error rates of these 


tests, and to investigate their robustness. 





Pe Ono Leonor THE TESTS 


A. INTRODUCTION 
There are two types of tests of a system (which is 
taken to be a bombing system in what follows). The sample 
size is determined as a direct result of the experiment 
in one case (and is therefore random), and the sample size 
is selected prior to commencing the test in the other case. 
The former procedure is called a sequential test fale) 
The test procedures being considered here are sequential, 
and are based on assumed circular normal distribution (that 
1s, bivariate normal) with the same variance in each co- 
ordinate. In the coordinate system of the target plane it is 
assumed that: 
X~ Normal (0,0°) 
Y~ Normal (theo) 
The origin of coordinate system is the target, and xX and 
Y are distances from the weapon impact to the target along 
the X and Y axes. 


If it is further assumed that X and Y are independent, 


then <= is normal with mean 0, variance l. —— is normal 
with mean 0, Variance l. Thus /( ie + j = )5 has Chi- 


Square distribution with two degrees of freedom. 





The density function of Chi-square with two degrees of 


freedom is [2]. 


fn (CE) = ea ae —tf2 t>o 
2-T (1) 
7 1, -t/2 


This is the exponential density function with parameter 


> 
tl 
Kol 


P Here, 


x y2 x24 y? , where X24 4 is squared miss 
g2 of of 








distance of the impact from the target. Let this be another 


random variable 2. Then, 


5 Exp (5) 
5? 


The density function of Z is derived as follows: 


Fy (z) = AS 4ag) 
-p[4< 4,1. 
Oo Oo 








feet a bees | 
6) 
= Z 
then Fy (z) = Fo- ( =e 


Where Z° is exponentially distributed with parameter )= oo ; 





Then 
Fo-(—=) = l-exp[-2/2.0°]=F, (2) 
Z ee ss oa Ge CI Ria 
From the relation eat = 2° the density function 
te) 
er % is [5] 
i 
5 exp [-2/2.9° ] = f(z) 
Zo" 
which is the exponential density function with parameter j= l ; 
2 
20 


Assume C is the median of Z (C represents CEP? which is de- 


fined to be the median of the squared Circular Error Probable 
[6]). 
Then by definition: 


caer 
Fy (C) = i 


1 -exp[-C /2.071= 5 


Cc aL 
a Rn (>) 
20 2 
ae = C 
2&n2 


Thus Z~ Exp eS 





If a bombing system has been specified to have median radial 
miss distance y, and if a system with radial miss distance 
y, is unacceptable, this can be tested with C,= ae as the 
null hypothesized median and Ci =y," a the alternative 
hypothesized median. Here, cae Pca ne sthe parameters 
under null and alternative ete. int distributions, 
respectively. 

In what follows C, will be treated as median under null 


hypothesis and C, as median under alternative, where these 


quantities relate to the squared radial miss distribution. 


B. TEST CASE A: SEQUENTIAL RAYLEIGH TEST 


If a system is to be tested with null hypothesis 


CEP’ =c 


eee |6C EP = Cy and alternative hypothesis Hy: : 1 
with type I and type II error rate a and 8, then a sequential 
test for Hy against H, can be defined as follows. We shall 
call this the "Sequential Rayleigh Test" in what follows; 
it is an application of Wald's Sequential probability ratio 
test to the exponential situation described above. 

Two poSitive constants are chosen, B and A, where B < A. 
At each stage (n-th experiment or observation), the probability 
E(z;% Cy) 


ratio , called the likelihood 


n 
II 


i=1 BAS CQ) 
ratio [3], is computed, where £(Z.; C,) is the exponential 


density function with parameter 2Nn2 , j#=1,2 


Ca 
5 


10 





n £(z., Cy) 


fcfess if Cm then another observation is made (this 
means the test enters the (nt+1) &* stage). 
If the likelihood ratio does not fall in the interval (B,A), 


called the continuation region, the test terminates. 


In termination, the conclusion is to: 


n f(z., C,) 


Accept Hy ae 30, EU ZoeGe) = iB; 
al; ‘@) 
n felZon eee) 

des a > A. 


Reject H. if MI 
J ‘e) al ie GAL) 


i O 
For a test with approximate level of significance a and power 
1-8, one may define [1] 

g B 


Te Oia = 
A=-=>- ' and B= 7 . 


Thus, an approximate bound for each stage can be obtained as 
follows: 


The explicit form of the likelihood ratio is 


n £(z;,C,) 
1 aL 
i=l Zo) 
3 (£n2/C,) .exp[-z,.2%£n2/C,]. --- -(£n2/C,) -exp[-z,,.£n2/C,] 
e Pe e @ exe = al e e map 
({n2/C) exp | Z4 2n2/C_] (2n2/C_) exp [ z_-&n2/C) 


—— 
— 


(2n2/c,)”. Ce z.).exp[-2£n2/C, ] 


em27C_)” . ¢ E24) exp l-8n2/Co) 


ick 





C n “Sai 
=|~o -/ ©  2;),f&n2 - 2n2 
Ci . fs 1=1 Cy Co 


This is equated to A and the logarithm is taken to obtain 


rejection bound R, for the n-th stage; 


en 
ai ( +P)= n.in{£0 _ ( 2 :} Q£n2 - Ln2 
Ci i=l Ci Co 


The test rejects Ee sLae 








where x 2: is sum of squared radial miss distances. 
The same procedure can be applied to B: 

B C e 
( ; oad 0 af “i 2n2_ 0 - - 


The test accepts Hy Pe 


ie 


(22) .f 2 - 2 
Cy Co 


Here, it is assumed Cee eo which is, we envision, true 


My 


2) 











Ze << 
alge 


ls 


in the bombing system test. 


a2 





C. CASE B: SEQUENTIAL BINOMIAL TEST WITH Py = = 


In the study of bombing system the target is defined to 
be a point on the impact plane and impact of a bomb within 
(over) some distance Yr from the target is defined to be a 


hit (miss). 


A null hypothesis that CEP 2 = Cy is to be tested against 


an alternative hypothesis that CEP? = Cy, with Type I and 


Type II error rates a and 8, where Cy F< Cy; 

Also this system can be tested with CEP 2 = Cy as null 
hypothesis and CEP 2 2 C, as alternative hypothesis without al- 
tering the test procedure. 

Let Py be defined as the probability of hit under the null 
hypothesis, and P, to be the hit probability under the alterna- 


2 


tive hypothesis. Then under Hoe CER <. C which says the 


Oo! 
true median of squared radial miss distance is less than or 
equal to C,, implies the probability of hit is greater than 
mieequal to 0.5. 
Similarly, CEP As C, implies the probability of hit is 

less than or equal to 0.5 under the alternative hypothesis. So 
the new hypotheses are defined as Hoi ee 0.5 and Hy: Py <2 Ou): 
From this hit or miss criterion r, a value of squared radial 


miss distance may be obtained which gives Be value of 0.5; 


me., if 


306) 





Fi(r) = l-e = 0.5 
O 


then 2£n(0.5) = (2n2). (- =) , sore=C., 
O 


The alternate hit probability Py is found as follows: 
2 


ae P, fait | CBP” = C)] 
= P_ [observed squared radial miss distance < r | CEP*=C,] 
Negi 
= le C1 
~ 4n2 ¢ _ So 
Cy ace) Cy 
——1- e€ oti! seer 


Let the random variable Z; be defined as: 
0 if miss (squared miss distance > r) 
1 if hit (squared miss distance < r) 
Then the likelihood ratio becomes 
f (Z5,P)) 
a 


rag 
onan. 


ra 
HePoas 


Gla (1-P,) "4 
AV (yey “ 


=f 
2h a Gee wie 2. 


n 
Where Z = fr Zz 
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For a sequential probability ratio test for the binomial 
situation, the experiment is continued as long as this value 
remains between B and A. 

An approximate acceptance boundary is found by substituting 


Bee for B [1]. 


1-a 


B n 1 
Then 2n fa)? ee 2 en ()* n.%n(2(1-P,)). 


substituting (1-27©0/61) BOG Py gives 


A n eed 1-c./C, 
Rn Tra > a as Qn eae Cua Gne +n.2n 2 
i=l 2 Oar 


n 
Selving for 321 Ze, which is a convenient test statistic: 


SS ye a 
a “ES Co/Cy *n 
gn (2 - 1) 
| Cof/Cy 
(The inequality changes because CQ< Cy implies 2 - 1< QO.) 


n : 
Where 5 2, is the number of bombs which hit the target, out 


i=l 
of the total fire, n. And substituting ==£ for A, an 


approximate rejection boundary is found to be: 


iB) 





gn (2-2) oe her 
n a Cy 
» 7h tS CAve n 
i=. + rn(2 ee -1} 


The test now operates as follows: 
in stage n, 


Accept Ho if < Zo Dy 


Reject Hy te fe : Ae A <8 


Continue to stage n+l otherwise. 


D. CASE C: A SEQUENTIAL BINOMIAL TEST WITH NULL PARAMETER 
WHICH MINIMIZES E[N] UNDER Ho. 
This case also has null hypothesis CEP “<Cy, and alter- 


native CEP“>c Let Py (r) be the probability of hitting a 


5 ee 
target of radius Vx, and let Py (r) denote that probability 


under Hy: In mathematical form: 


fob fs hare 
2 0 
Py(r) = 1D gy ese Ske = Cy) = l-e 
eee i. 
k. a e9 
Putt) = P.(Zsr|/CEP“ = C,) = l-e 
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Co/Cy 
Thus: Py (r) =l- {1- Py (x) ] 


It is desired to determine r so as to minimize expected sample 
size n, required to test Ho vs Hy with Type I, II error rates 
a,8 respectively, using the Binomial Sequential Probability 
Ratio test. 

The average sample size function is 


EB (N) & (1-L(P)).2£nA + L (PB) .£nB , Cll, [4] 
Pix 1-P, (r) 
P.gn (a) + (1=-P),2n ca 
where P is the true probability of hit and L(P)=P_ [accept Hy|Pl- 
ila Py (xr) is chosen to be the underlying hit probability, then 
L(P) (r))=1l-a. 
By substituting L(P)(r))=l-a, 


eee, P, (r)=1-(1-P,(r))C,/Cc,,B = _8 
a 1-a 


in E{N] function, the expression above becomes 


a J+ c-a)an(res) 
0/1 






C 
1-(1-P, (r)) 
P(r) 


Py (r)s{kn ]+(1-Pp (r))&n[Q-P, (r)) ] 


If a value of P(r) which minimizes E(N) is obtained, r is also 
obtained from Po (r)- The numerator is a negative constant as 
long as 8<0.5 and a<0.5 and the denominator is a negative variable 


depending on r. 
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Therefore, in order to minimize E(N) it is necessary only to 


maximize the absolute value of the denominator. 





Then for various values of K, Po(xr) may be found. 
FigurelFlshows a plot of P.(r) vs k resulting from this 
minimization. As k approaches infinity Po(r) approaches 1.0; as 
k decreases to zero Po (r) decreases to around 0.63. Specifically, 
for k = 2 

P(r) = 0.8416, P(r) = 0.6020. 
From this r is found to be 


-2N(0.1584) 


~ Cy gn 2 


= 2.65836-C. 


Let Z be a random variable such that 
0 if squared miss distance > r 
i if squared miss distance < r 
where r = 2.65836. 
Then the hypotheses in this Binomial test becomes: 
Hy: Py = 0.8416, H): Py, = 0.602. 
la eons 0.8416, 2, = 0.602 are substituted in the likelihood 
ratio (similar to Case B above), acceptance and rejection bounds 


eemstage n are. 


Accept H, a Se 


_ B = 
1 71s Pd 1.2564 . ie a err tae llenWs.? O38 — A, 


6 





(xo y 7 


PO 


1.87 
Tee 


4. 53 





5,03 


J 


roe Ces Spal “ahh, 3.53 14.93 
e cota 7° 
K 0.001 Oat O23 OS 0.90 oO 1.414 ies 
ie 0.632 O65 5 02707 0.745 0.789 0.800 0.820 0.824 
K 2.0 BO 0 ye. 0 ORO 20.0 50.0 100.0 
Po 0.842 0.863 0.886 0.899 0.910 0.928 0.944 02953 


FIGURE Li-l 


iL) 





Reject H. if 


x iB 
E Za, ¢$ ~ 1.2564.% ( ==) + n.0.7333 = RL 


Continue otherwise. 


E. CASE D: A Sequential Binomial test with null parameter 
which minimizes maximum value of E(N) 
In the binomial situation described above, the hypotheses 


about the parameter are 


Ho: P= Po 
Hy: P= Pi: 
The maximum average value of E(N) occurs very nearly at 
sof err 
P- = SS [4] 


P, (r) is (r) 
gn gn 
2 a) — ) 


from which 


Peas 2 1 
E(N) = P) (x) I=P, (r) 
mt (r)/ 9 -P (r J 
Oo @) 
_ Aa. mB 
1-(1-P. (x) Fo/Cy | ((1-PQ (r) F0/C4 
gn 
Ee oa 1l- Ea Seay 


(P(x) = 1 - (1-P (r)] CofC] see Case B) 


The numerator is a negative constant for given a and 8. 
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Similarly as in Case C by maximizing the absolute value 
of the denominator, the maximum value of E[N] is minimized (or 


at least nearly so). 


Cc 
Figurell-4hows the relation between Pfr) and k = = : 
O 
Specifically for k = 2 
Po (x) = 0.89867, P, (x) = 0.68167 with r = - 2n(1-0.89867) = 


qn 
3.30286 is obtained. 
Hence the hypotheses for this case are He: P=0.89867, 
Hy: P=0.68167, and "hit" is defined by squared radial miss 
distance less than or equal to 3.30286. 
Let Z be a random variable such that 
0 if squared miss distance > 3.30286 
1 if squared miss distance < 3.30286. 


Proceeding similarly as in Case B, the decision at stage n is 


Reject Hy aes 


nN 
> Z. $ -1.42167 . &£n(1-8) + n. 0.80552 = R 
— if n 
Accept Hy iis 
nN 
» eA 2167 ween ( g ) +n. 0.80552 =A 
i=l I-a ep 


Continue to state ntl otherwise. 
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10.00 


K O..05 
Py > 
K ies, 
ae Otel tbey 





409 8 60 3-00 46.99 42. 09 
K 
0.1 OS: 0.5 Or? 0.9 Oe 1.414 
ese CUZ O.6or 0. /3090-/60 0.794 0.851 
AY ISS cr!) 4.0 3.0 7.0 10.0 
Weocg 0-92) 0.944 0.968 0.982 0.994 90.999 
Peat = Z 
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Til. DETERMINATION OF SIMULATION FACTORS 


For convenience the hypotheses 


Ze te 
Ho? CEP” = 1 
4 2 were selected. 


Hy: CEE 
This means k = 2 in Case C and D. 

Type I and Type II error rates were selected to be 0.05. 
But actual simulation gives Type I error rates .0258, .0468, 
.0396, .0292 and Type II error rates .0396, .0402, .0420, 
-0400 for Case A, B, C, and D, respectively. This point is ex- 
plained in Chapter 3.3 of [1]. Approximate error rates of 
0.05, 0.05 (Type I, II) were obtained by adjusting the bounds 
A and B, which is possible by changing a,8 in A = — , B= 


cts - The adjustment factors used here are: 


llega 36S OTS ONS: 


CASE A a= 2.0 x 0.05 


eee Os US 


Seles x O05 


B 
G@ASE B a= 1.2 x 0.05 B 
CASE C a=1.5 x 0.05 B 

g 


CASE D a=1.5 x 90.05 ree sx O's 0 


1! N. have Bi- 


nomial distribution with probability of success 0.05, a sample 


How many replications are enough? Assuming N 


size n is found such that PGE | <3 = l-a , where ais the 
Significance level, Pas i=l,2 is the estimation of P,. The above 


equation implies 


P.(-c <P) - Po <c) = l-a 

P,.(-c ee lpg 2 S$) =) 1b! 
n n 

P (-nc< N - N anc) = l-a 

a 1 2 
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By the Normal approximation , (Ny - No)~ Normal with mean o and 


Variance 2np(1-p). 


Thus 
=a 
ce { - nc : Mal Ze eee ee less 
— —— 
2np (1p) V2np (1-p) ¥2np (1-p) 
gives 


nc = 25 


Om 
y 2np(1-p) ce 


The following table shows n for various values of qand c. 


: = Ded Otel 0.05 0.025 8107 
c ’ eco 1.645 5 SS 2.24 74) & 
eZ S58) 6.4 eek LD DE PAS. 
Oe! Saf PAS) 5 J SiG 47.6 SoS 5 
G05 Oa VW OPA ate! 145.9 gO. 7 206.3 
e025 7S OSS) 411.3 SS a (OZ ae eZee 
0.01 1568.7 PASH Ole J 3649.5 4766.7 SIS Ie Ss 


meoot 156866.4 257072.3 361237.5 476672.0 515745.5 
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Assuming c = 0.01 and a= 0.02, an approximate value of 
5000 is obtained through the table. By this number of re- 
Plications, obtaining a difference in estimated error rates 
Peeater than 0.01 is significant at level 0.02. Exponential 
random samples were generated by the Monte Carlo method. For 


an exponential variate T to have median m, it is necessary 


to use the scale parameter) = enn 2 
m 
Ane 4 


SO F(t) Seem 


But U = F(T) heonarormiy dastributed on (0,1) [ 8]. 


Thus 2 MM” =] - F(T)=1¥U is also uniformly distributed. 
mimally T .fn2 = -<£n U, or 
m 
T=-m. gnu 
In2 


By changing the median of the population sampled, the 
Seeracting Characteristic function, expected sample size at 
termination, and its variance can be estimated for each test, 
and those can be compared. 

The medians to be generated are those which result ina 
Meeeditterence of operating characteristic function values 
in Case C, which is based on minimizing the maximum E(N), 
those which yield Type I, II error rates, three points which 
yield approximate maximum E(N) value (for Cases B, C, D), and 


five more points in both tails. 
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By changing the skewness of the sample distribution, 
comparison of the robustness of the four tests of hypotheses 
about the medians under null and alternative hypothesis was 
performed. 

This is based on the assumption that the underlying 
distribution is WEIBULL with shape parameter a and scale 
parameter i. 

If T~ WEIBULL{a, A }, 

Ene Gistribution function of T is 


: fo) 
F(T) =l1- BO) 


Let m be the median. Then 
eines m)) = 2 it < mi; 


0 
mo ("™) _ 


O25, 
fe) 
R™0.5) = -— (d-m) 
Solving for ), 


a) Hil 1l/a 
A = wl en2] 


O 
Mewei-e ~'4T) __ Uiord) so 
g@n(i-uU) = - (AT)® , 
il 
T == [en(u) ]® , where U~ U (0,1). 
substituting A = 2 (zn2) 1/0 
— (3 
= 1 
T =m - GWEIBULL{a rab e2 y1/O 
nD) 
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Following histograms in Figure III-l show the effect of 
changing a in WEIBULL. As a decreases the distribution is 
widely spread and it is said that the distribution has heavy 
tail (Figure III-1, 8). In the opposite case; i.e. a increases, 
it has light tail (Figure III-l, A). 

Figure III-2 is observed keeping a fixed at 1 and median is 
Meo l.0, 2.0 in WEIBULL. 


anaes 25 exponential distribution with median 0.5, 1.0, 2.0. 


27 





Ce. OT 


° f e 
{ZEBL°O “S°T}TIINGIAM ‘WI-LIIL WyunNoLa 
00 359525T°S NANWIXVA TO-3299509°S NVIW Wa74 
OOD atses sl < JTILNVAOD 06° COSTE E 7c: y 2V139 TO-29E€T802°6 AVIAYdSAINW TCH$SEOCIES°BR NV3AN WI39 
00 3SSE303°1 (JONIH) 3STILNVONM SLl° POestz2ecc "9 Tv138 00 33E400ET°Y JONVY 00 39712L0°2Z JINVUTIN 
TOWSE99TL3°6& (NVIOSW) 3TILNVND Gs? TO-30255%8°B SISCLYUNY TC -36E0L9B°N°S A30 NV3W 00 3°5€5T0°T NVSWOIW 
C-39T#S13°S (J3ONIH) SITILNZNGD Sz? LO=3GER7C5° 6 S$SANMaHS TC -30829E9°9 YVA 343509 00 38bSLTI°T NVSWIUL 
LO=3S99¢C98" 2 3VILNVAS OT° 09 35L¢°°S2°T OW TO-3cSOLES PL A30 QLs TOK3EOHT13°S NVIQ3W 
cO6-369Sc¢Se °T WOWIMIW TN-3021552°% ew TO-a9TLOB9°S JINVIYVA 00 S3CELSETPT iV3A 
NIILNATYLSIO SLNSWIN TVYLN3SD YSYHOTH Ovauds AINIINAL IWYILNSD 
TO 300C000°T JL 0°O wWOYS JSXIF 31V9S 
cae So ae a Pie ene Ec ie ed rear ate mm oa al and 0°0 
ee me et me me tn Fm Fe ete me fF mmm fe me Fm me eh mee ef me me ef me eh we me fe te we fmm me fem mH a oe oe Ea Hake Kok ak otek hak Pte aK Bak aH KE OE KW OF ok OK KEK KK 
meee eK KER KO mK KK ke Kak Ck RAO kee Kk eK KKK 
Rexok oko kee kok kk gokk Seok RWS kek Oke KeK 
wee ke RE ke kek SRK ENO KER O RRR KEE 
Kok soke SKK okt kkk Ske KANO Re RO KKK KKK 
Rokk tok kK eee KKK Sk KN KEKO KEK KaKIZO®S 
kee ke KK Sk KN Keke Kk eK KKK 
okke kkk KKK PKR KWO KK KOR KER Kak 
Rokk eke KEK Sek KWo KEROK KK KE 
Kak KEK Kee PKR KANO KEKO KKK kK 
mak tie Sek KWo Keke o KR k&kE IED? 
mem KER See Ae KERR KR KEK 
kei Ske Wo kKESKRE KEE 
kek See RWS Kee TREK KX 
exe Ske kao KKK TKR K KEK 
kee Sek Wo kKES KEE Kak; IO® 
eke Sk&R KAS ke ROK KK KE 
kee SRR KANO ERO KK eK 
eek Ske ENO EKO KKK KEE 
kik Ske NO Keo KKK KAK 
kkk Sk&R ENS KKKo KEE KeEKISO® 
Pek KAS EKKO KR KE KK 
Pek ENO RK EO KR KEK 
Pek AWS RK KOK KE KEK 
Pek KWo KEK RRR KEK 
"ee EN kK KEK HeELOT® 
xm Wo KK KOR RE KKK 
Same KAS KER TR KE KKK 
Pek eh? KKES KEK KKK 
Ske KN KEM KKK KKK 
Sak KWo kKEo KER xaxe([ZT° 
Pek KN KREMER KKK 
Pee ENS ke KOR KK 
Sake KW KE KO KKK 
Smee KWo KER OK KE 
Pek KAS KK EO KER bT° 
Sek EN KEKE KKH 
Pee ENO KK EO RE KE 
. Wo ke Ko KR KE 
: Wo &kKeEo KK 
¥ Wo €& ko kK 7T° 
vf N° kk eo KKK 
i N° kKeEKoT KKK 
. N° &k ES REE 
4 N° €e Ko KKK 
: Wo KEKo KEE 3T° 
: Wo kek eo KK & 
e ae “exe 
id w° "eK 
S N° "kee 


28 





O° 


T eS 


TNA Oooe 
OODOMOO0OO 
;if 

WU LU 0 Wu Lu Us 
Ale 10J CO. Oo 
NDW HLUVO O 
NGM OO.am 
(eto STG) us 
(QVNWOP MOAIN 
emiif\ (NI et Vu VCO 
of eet @ @ @ 
ADM HOON 


oo 


on ome 
WwW <u 
Ono 


my 


ZOz 
od LS ae 


A Be 205 & 


& 


: 


{€26S°0 


i 


YW NOHO ane 
rm QO0O0900 


< 
WwW Wil 


= 


0°? 


NeatPons 
VU VwoNorae 
MONWNWO 
LUA CD 


=. 


MN 
Ym 


{> 


WwW) 
ZO 
£e Wa 
ua 
wVeF ~OWUW 
rc z=zE=MYoo 


N3D YaHOI 


f 


oa 


aADOOHO 
OQOO09OONO 
UW WU UW) Wu WL) 
ODiINDNT wy 


TO 3000000°T 


mL Mt LAO 
TUM—O40 


eS 


orp Od-o 
f= CO UY et OS and 
OAINAAN 


AOHAIOIMY 


‘L£°O ‘TINHISM}‘AT-ILI FuNoLa 


J 


F es 


L 


O° 


i 


OOO0OVsAtAN 


o°9 


€° 


Uy WU Ld uy Us 
PTDOANOAOD 
Ot QOVUMWT 
OIw tor 


Pe woe STAR ES BA 
eoeeete @ 
QO Nett t ON 


x 

wi<t<o 

a eOWwW 
“qt cee 


WOYUS ISXIS JWIS 


an 


© og 


he ate hak eH ae ake ake a ak to ak ak ba aa Ko REE REAR ERK KEK ERK ERE KK EEK EK RSE OKA KEK ERK KERN KEKE AE RE KK EE OAK KEEFE KOK KR 


kok ok XO 
rs ote Xe 

We ak ok 

ak oe ak 

te ke a 

ek ak 

a 


RRR eR ke RK KEK KK 
Raok kek R kkk ke ke 


% Xe ak 


* kK 


KKK Re eR KKK KK ReK 
week aR kee RK RK RK 


Mok kk 


kk x 
kak 
teak 
kk 
€ & 


we aK aK 
eK AK 
% ak 


ee 
Xe ok ak 
ek ak 
ek ak 
ke ak 


See 
© dex: 
° em 


ke KK 
x KK 
mK & 
KKH 
* ok xk 


OK & 
eK ak 
mk & 
we & 
me ak i 
mm & 


kW & 
* Wk 
* We 


FSSASRELSTPATZATPTTTTPAADPATDTTAZTATATALTATALALATTFSTTTATZS 


* eK 
eX xk 
He me 
Xe x 
mK 


& & 
ik ak a 
mx & 
Kee 
& kk 
te 
ee 
€ kx 
kok & 


& & ak 
ak te ok 
tok 
tk 
ek 
eK 
& & 
 & Xk 
xk & 
tk ak 
mK 
vk ak 
ak 
tk k 
Kk te x 


° i 
° ak 
° & & 
* ke & 
ke 
"ee 
“tk 
kK 
ke 
em 
ok & 
* & & 
ke 
Pek 


KK 
xe & 
mx & & 


&& ° 
& & ° 


ay 
had 


RRWWHRARRRERHKRR 
HRRKPRH RHR eR 
eeeee ee eF @ eo & © @ 


ex & 
ke 
KK 
we & & 
& em 
& & & 
ed 
Ky 
Ke xX 
& & & 
ek x 
ek x 
& x & 
% & & 
5: 
& & ox 
ee & 
& x % 
& Kx 
& & x 
& Kx 
mk & 
eK x 
eK 
eke 
& ok xx 
i ok 
eke 
& & & 
KK aK 
& & we 
KK ak 
* *x* 
& ke 
& kK 
Kk kk 
& kK & 
kK & 
* xx 
mK ak aK 
ok 
*€ k & 
ek & 
ak 
& x & 
k Kk 
& KK 
eK 


«x x 


(15 UL CY pme LL < 
Z2FLA0UL 


uu 
WY 


uy 
Oo 
e 


sT° 


Ur ag 


29 





| 





t 
’ 
’ 
ts 
° j 
i Mm 
t oa) 
-—— 6 
f oO 
’ 
Ja 
§ 
t 
t ~e) 
A ~— 
| fe @) 
$ 
t 
<p 
$ 
‘t o& 
] oO 
a -— @ 
t @ 
t 
’ 
ap 
0 
t faa} 
+ ™m 
>— @ 
{ ~ 
t 
. t 
as 
: { 
t ~ 
t Se) 
+ © 
t oO 
t 
. t 
do 
t 
0 L© ] 
t oe] 
~— 
iw 
t 
t 
fo 
t 
t ceo 
t «tt 
+ © 
t uy 
t 
t 
ots 
# 
+ ~~ 
t+ <O 
6 
t we 
t 
t 
to 
t 
t oo 
| © 
t >— @ 
> 
t 
t 
dp 
y 
} aa] 
t co 
+= © 
* om 
+ 
+ 
be 
wt 
Hee 
err Oo 
_—— 8 
HHH GN 
tH 
% Ht Ft 
> 
tt Ft Ht 
tHHHH OO 
HEH OO 
+-—- 0 
RR He KH iN 
eR RR H 
HRAeH 
KHKERRAR HA 
fe eT Ht wh oa] 
HHPHRARHHRH (9 
~—— 98 
HHEHERARAREHHH KF 
HRHARAARRKR AA H 
HH se RR HR ie He 
S®eseeteeeeesepeteeenvneertetreeeveetoert tFeeeerte#we*te @eeeteeestest ee e@ @ 
RHR AMMAASARKRARKR AAR MH 
RKARARRKRKHK VW Cee KX KH  haoaad 
BEBPWwBABADRETAALTATA!NDSSATMTTATATTAWXwNYTFALTAVAA~AVWTATAZTAATATZ2A=Z= O 
== @ 
ITNT”. - 4) 5) cl'g)b. 6 ¢ 0:6 61 6..4) Sueatis O00 © 6 Se 0 ee ee eee tenes oO 
| RACTKRRAKARKAARRWAARARKKKKKMKKA TKK Te HK 
RRRRRWSRRRAR HAR SRR HAR RS H 
oo 6) We gains alg cg ue-e ee 0 eusgalieceie 0 6 6 ee eee sees 
hse H HH EE EE ERE EER TH RTH ARARREHAARARHARRARARRKARAHH HH 
WHR HHH HHH HH RTH HTH RTH RAK ARERR ARHARHRARRHRHRHRERR CO 
pc a eg tf SEY @ 
1s) ur CS] re) w ra) Oo 1 Q 
> m m N N [on = © 
e t e 9 e 9° e e 


1.QQQ00CE O1 


TC 


0.0 


SCALE FIXEC FROM 


DISTRIGUTICN 


HIGFER CENTRAL MCMENTS 


SPREAO 


CENTRAL TENCENCY 


WH HAO? 
OQOOO9O00O 
ttetae 

Uy UL CL Ly UU Li) Lo 
Ot DWMapr 
OAM ODAIAICD 
ANS SAID 4 
Bir wUOowrwe 
FHT TowW 
WOIWIn 41. UY 
oF ee @@ @ @ 
NMP Dea? 


=m 
WW <TlLW) 
(oe 
a on 
o=e LL) = 


Lert 


mee? tag Saye 


LULU Wt 
ad 5 
4 4 bd Pd pe 
Re SEE 
Coe eee 
zadaqaqse 
= |i [se fem ee B= | 
=OoogoI9gI90=2 
— b+ 


ZOWNMDAUVGS 
mot CNEL OD 
= eee @ ot 


=OQOOdAO 
Oo0o002o 
U { 

WU WWW 
DCO fF Ur 
M™ OU nr 
COC .NIDUW-4 
TWN St 
ACI OLN 
UV w@aP Uy 
e®eeo8¢8 88 
Aaa Tia - 


MWY 
Vm 
Ww 
ZO 
x4 a a 8 
Wore 
(At ~OWLW 
> ep lp ae o | 


aAH4§ 4 +O ~4 
Qoooo09 
edd t 
UW WU UU Lu DU 
mA AI ce 
Mir. NOOO 
NNOoOaf 
WWOuVA@d 
ODMAHOMm 
OM ABA 
eee. #8 ¢@ 


PODS 


Q 
Ww w> << 
O>dtw Ww 
zw>OoO @ 
Ia Wa. 
— UL ZOown 
CMOW {ZO 
t-—Ow te 
PuUUOL&L= 


Fe Lame Kao bee OP Te | 
SIIIBDOWODWV 
(ted 4 0 
CL) LL LL UL LL oe 
ROW MOA 
Mm OU Pod uy 
TMCIWD DA We4-Q 
™=OrMm MO exfer 
(TYU VAT WD apa? 
CUE CU sy Us (85 
® @ee@ @ @ 
MIT UN STON CH ot 


Ze 

w< a 

a2 ZW 

LL oe 
TtuUWwW<f 

Sea SEees 

QO OU ee 

UJ Lt Ot ort 

22R2eok 


FIGURE III-2A, WEIBULL{1,1.3863} 





10.0) 








. * 
] + 
| it 
- 
’ 
1 m 
] m 
| d—_ 9 
oo 
| ’ 
1 
' Pp 
| 1 
1™~ 
1 wo 
r— @ 
| 1 @& 
4 
| 1 
h + 
t 
| © 
1 oOo 
+—_— »* 
1 wm 
1 
1 
+ 
i] 
1 ety 
1 ity 
~— e 
| ~~ 
t 
x | 
+ 
1 
1 fm 
4 Ww 
->—o_ 6 
+e be) 
+f 
, + 
~~ 
1 
1 Qo 
1 > | 
~—2 6 
ett VO 
+ + 
% 3% 
<p 
tt 
tk m 
Se, a Y ist 
-— © 
+ t+ wr 
% TH OF 4+ 
% HHH 
+> 
+t + 
tH fH 
+H oO 
~—_ 6 
RHR T 
RH RH 
tH te 3 tt 
+ 
% 4% 
Rt t+ © 
#H#HH% QO 
+> —_ e 
He HeHe OS 
3% 3 Ht 
% HH 
oe 
HH HH 
3% HR TH WW SE (aa) 
HHRHH CH 
-~_— é@ 
HHH RK H ny 
UHHH 
ee ae ce 
HHH HH HH H 
Ft HH HH HF f~ 
RHERRH RRA  e) 
-~—_— e 
HHH HH HH OH OH Cas | 
te tt Fe tt He OH OH Ht 
% HHH HR Ht OH OH Ht 
+> 
AR HH HH HH Ht OH 
HARFRHHEHTRHH OC 
HTH HHH tA HH © 
®*@eeeeetrteoeetrteeeeetrteoetetetreevrpreeteeeetrteeoertert © eee eter eee ee © gu @ 
Rt were RR eRe ERR tN 
HHH HR ewe HH ie He Ht Fe 
+t tt tt te Ot fe Te te Oe OH Te Ht OH OFF 
+ 
HRPTRHARARRAAH HH HTH 
je te we Te HR OR OH ER OH Ot OH Ot Ot my 
ieee EE EES EES ETE TES SSE SERA TIESE m 
— @ 
eH Ft Ht OTE SE Oe OH OE Te OR OT OT fe St Oth ee OH Ot Ot OH OE Ot Ot Ot owt 
te te Te Te OT Te OH OR OH OR OW TO OH OO Oe OR Ot Ot 
tt 3 3H HH Oe SE OTE OE Oe ie St Sk OR Oe OH Oe Ott Ht Ot Oe Ot Oe OH OH 
@®ereee?*esesrteenpeee7#n7eeoetrteese@eee#eeeeec_i@eeee#e#eer%fee¢eeee#28t et @e ee ee @ 
RRR SR RRARRRARAARR RRA HH 
RPAH ERRRAKARKRRARW rm 
SRR RD RRR TRH RRR RRR He Lo 
-~_— é 
RRR RRR RRR RR RR RRR RRR RRR RHE HR RRR AARARR ERR = 
®ee@eve@eetreeweeeeeeepeeeeeeeeeteeteeewseeereerteteeereeeeeeeeerte e 
RRR RRR RRR RR RRR RTA R RA ARRARKARARKARRKRKAKAKAK ARH HHH DH 
+- 
RRR RH RRR RMR RHR RH RR RAR MRHERARAKARHEARRHRAWHRKARARHRHTR 
Ci ee ee el i a ee 
RRR HHH RT HTH RHR HHH HHH HER RHA RHA HAHRHHHAHHKRHHRHA RHR HH RHE a | 
ee e 
Oo uy = uy ws 
N owt =~ © 
e e ce) e 


7 Sial 


1.Q0COOCOE Ol 


TC 


0.0 


SCALE FIXED FRGCM 


OISTRI@UTICN 


HIGRER CENTRAL MCMENTS 


SPREAO 


CENTRAL TENCENCY 


WNtHaHQOgS 
CoUeO9009d 
rt 

LOL LL 
wih FOOT 
CUD NOt Ph 
LAFMOUVP ON) 
QT NQWQWI1O 
ALPARrCOrN 
BOF UID gy 
eeoeeeee 
UN FOOD OY eg FHS 


mo 
Lu <I Ww 
Orc 
ZO 
o—~4 LL pe 


a> 200 


a ee ee 


LL Ly od 

wd ted ood 3d aed 

Hd PE pt meg PE 

eR 

ae oe ee 
z2Aadqaqaa 
== eS [ae pom ae = ee | 
=ZWSIII—0= 
—! 


— 

2 OMOWEX< 
me MIO UNE Qh <f 
= ee feo ed 


OnrtO004+4 
QOOO0900 


SUL LU LU Ld 
OM OALWISH 
OWPOWd 
wer touting 
ot UN ue 
A416 O UV od 
Tete 
ee egeee 


PN eto 


nur 
we 
uw 
Zum 
seta 
Wap 
Mt Duww 
=ZMwowo 


OdHHOIO 
OVda070N 
| 
UI Ly USL 
OOm waren 
LALA Oe 
MOQ WAP 
mm Oewovu 
FO MAI 
MAMNHHOguy 

ee @@% @ @ 


== OY OrOVor4 

Q 
uw a> 
UOr>dadw wWw 
Zw>o « 
IO wa. 
m~ ILiZigw 
COwazZo 
qe OW <es 
>NOULes 


ORtO AGQHN 
meer clnerd 
‘ ’ 
Air hn ori freee 
LAM AIAN OS 
ANOS OUVGg 
POWDAAH 
PIU 4TP STUY 
QOToryyouror 
MUO WOR Ws 
eeeeteee e 
SAN aN 


Zaz 

LL) <{ <{ 

2 Ow us 

Ad«( Zit 
Tiwus<f 

ZaTe2eTs= 

QW) resOLsL am 

ULI LL 0% pt reg LL <I 

SBR ABYL 


FIGURE III-2B, WEIBULL{1,0.6931} 





O0°OT 


TO 37S2S85°T 
VOrsgect cy 9 
OO 3e9SLT3°¢E 
00 3S0T006°T 
ROS 9780 L 
MO =1855 758° ¢ 
PO=370TeLt- I 
3 


MR km eK hak 
wore eK mK km & 


ste ek 
kok 
ee ak 
oe ke 
He mek 
he a ate 
ae ae ak 
ae ak ak 
He ok 
He ak ak 
XK ake ak 
eae a 
ewe ak 


Xe ak ak 
He fk 
ak 


J°8 
I 


mK 
* %& 
OK Xe 
me He KC 


ae 
ek ok mR kk 


Mem ok ek i ak 
Meme Me ak ak 


{99VE°O‘T}TINGIGM ‘OZ-III wYuNoOT 

ANWIXYVA ZCO-3TZ2L052°S NV3IW W 
v70 05° 20 39T9398°E evl39a CC 3S0S5€0°E& QV3SUdSOIN 00 32l83ES°T NV3SW W 
VDSS * TO SLE4305°E tvl3@a TO 32%¢S85°T JONVY OC 3E2E925°5S JINVY 
vn5 cs° 00 30582S5T°S SISOLUNY OC 32£EE9Z26°T A3Q NV3W 00 382£935°T NViW 
Vile ge = OOS StocZ97 7 t™ SSaNNsHs TC-31%C0€E6°6 YUVA 3309 0C 309755) °2Z NVSW 
Too. OT * CO 3457253 °EC + W 00 3T0LS5TL°2 A320 als 00 3929T005°T NVI 
ANWINIW TO 3S698S552S°E EW OO STSOSLE° JINVIUVA 20 3¢2e8bFLl°2 N 
dIYLSIQ SLNSWIN IWUYLNSD Y3SHDIH OV3udSs AINIINAGL WWyl 
TO 3000000°T JIL 0O°O WON OSXI4 31WIDS 
t*? a E°§ bry a Ere Lee ore e°T L°9 0°0 
He ae Se A ae ae ae te i a ake oe ak mm mt oe oe a te eH ee a a a He eo ae te bk ee Hk a eK hk a ee ee a hk eH kak oe Hx © g PR HR PR NE okt ok a HY de tak a ok tO RE A KE 
Ke EK Re aK KKK KK KK KEK RK KOE Rok KK KA oka ote ae ak oe KER woke OR KEE Oe 
Re RK ee eR eK a OK dk oko ot Ok kok ka ocak eck ecko Soak kek kak ROK kK Re 
RRR KEK EK a KEK Ke eR RR ok kOe ak ke tor kok kk Ske kk tok OR RRR RK 
Kekok EK KER ke kee oR ok oko kok Ok kok kok oka A ke kK Ske kek kK ROK KAR KK 
Kee KKK mek RR wok ket oko ke Ok Oo kak kok REA Ok eK OR RK RRR KOR RRR KOK 
ok & Memo aR kk ok gk tok ok Ook kok ook ok WD kook kok Skok okakok koe OK ok KEK 

ok & me KKK RR ROK eK RK KEN KK kK Oke kek KEK KOK KKK KEE 

me Rk koko fete ok Po kako oko kA, kskok doko Sok ke ke Ok aR KEK 

meek KK ok moe ka ke REA RK Kok Ck ke KK KOR KAR KK 

Mok ke me Re ok KW ee kak Sak Keke EK KOK KARE EHS 

3 fe 3 we Sok go kak cok eke ck SRR Re KEK KOK KKK KEK 

aK ke ok Sok miok xk WA koko ok ORR ke ke KOK kK KE 

ate me REN KR RK CE hE KEK KOK KEK KKK 

ee” MOKA Ok oR koko Sok kK ke ROK KER KE 

He ? ok eaN KR eR Sem KEK Re KOK KEE KK | 

me © ok woRA kK woke Sek Rik kek KOR ke eK 

mh 3 MaA RE REK CKR Kee KKK KOK KE KKK 

x ° xX wKW eK ko CR eK he KOK KR KKK 

9 ok mokA Ok moke Ske eR kEK KOK KKK KEK 

% ° ok we ke kK Coke Re RRR KOR RK Ree 

N *kee kek PRE kee kok KEKE REX 

" WN eee KKK Cee max koe kak KKK 

a WH ekee KKK T&G kak eo ek RK Kok 

eZ W kee kek © Keke OR KKK KEK 

> N kok ame Kok eo Rk KKK kek 

i N kee o mek £OR KKK KKK 

. Wok oka ° mek kok KKK Kee 

. | 4 mee FR KEK KKK 

w : wea EPR KK KEK 

2 N 5 Rok OR Ke REE 

. A wok «€o Kk €EK KKK 

% N si me kok KKK KEK 

. N ‘d Kee KOR RKK KKK 

W ‘ mee OR KKK KEE 

° N e mek OK KEK KK 

. N : Kok Oe Re Ke 

: vy ed Kee TR Keke KKK 

2 A . mek Ok KEK KKK 

. W e Kew OR KEK KKK 

. A 2 KK KOR KEK Kee 

a W ° eke KOK KKK KEE 

. A . kee KOK KKK KKK 

‘ N : eo eR KEK ERE 

. A . e° xk kK KK 

: A : eo ek KER KKK 

. A 7 ° €EK KEE 

. W . “  k#KE KE 

e a : -  €kK KEE 

° N . - kK kK 








fols 


70° 


80° 


OT° 





IV. RESULTS AND COMMENTS 


Simulation of the four tests were performed 5,000 times 
(5,000 replications). In each replication Ho? CEP“=1; 

Hy: CEP =2; and Type I, II error rates are 0.05. 

The following tables IV-1,2,3 show the mean number of 
terminations, their variances, and number of acceptances of 
ee in 5,000 replications. 

Table IV-lshows the effects of changing median values, where 
the shape parameter of the WEIBULL variate was fixed at 1.0 
(the exponential variate with changing median). Table IV-2 and 3 
shows the effects of changing shape parameter, the median being 
fixed at 1.0 in tablelV-2Zand at 2.0 in table IV-3. 

For ease of comparison these were graphed. Each figure 
contains four curves and each curve represents the case A, B, 
eeor D. 

In testing the difference of E[N], null hypothesis would be 
in) = E(N.], where N,- No are random variables representing 
the number of termination by test cases which one wishes to 
test the difference of the E[N]. 

By the central limit theorem [2] the difference in E[N] 
greater than 1.96 x6 is significant at level 0.05. ¢ is 
estimated on cory eer of N. But it is different 
between the test cases being considered. 

The larger one might be selected so that we may not 


reject H, erroneously. 
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REFERENCE FOR THE FIGURES IV=-l1 - IV-9 
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The interpretation of the figures is as follows: 


Ae 


Variances or standard deviations are approximately pro- 
portional to expected sample sizes. 

Test Case A contains the minimum expected sample size and 
Test Case B includes the maximum expected sample size in 
almost all instances. 

Case C and Case D yield similar results when median is 
changing and shape parameter is fixed at 1.0. 

Test Case B 1S invariant about the change of skewness 
when the underlying median is 1.0 (See Figures IV-4,5,6). 
Case B also gives the lowest error rates if the bomb im- 
pact has a heavy tail distribution under the alternative 
hypothesized median, and has light tail distribution under 
null hypothesized median (Figure IV-6.9). 

Case C gives the lowest error rate when the true median is 


2.0 and bomb impacts are clustered around the median. 


NOTES : 


Ae 


The adjusting factors of the error rates table were devel- 
Oped iteratively and there is no guarantee that these ad- 
jJusting factors are the best ones. 

There could be further investigation of effects under er- 
ror rates other than 0.05, or of changing null and alterna- 
tive hypothesized median values. 

The Fortran program for this simulation is attached as an 


Appendix. 
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V. CONCLUSION 


If it is certain that the bomb impact is Rayleigh distributed, 
then Sequential Rayleigh Test is appropriate to test the system. 
In case one has doubt about the bomb impact distribution, 
the Sequential Binomial Test gives better tests than the Se- 
quential Rayleigh Test. 

Further, if there is some reason to believe that the 
median is likely to be 1 (so the test is likely to accept Ho). 
Case B (Null parameter Pi=0.35) is better than any of the other 
eeoee tests. 

If the median is not likely to be 1, test case A (Sequential 
Rayleigh Test) or test case C (which has null parameter that 


minimized E[N] under H,) are the best tests. 
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